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We study the relative entropy density for generalized Gibbs mea- 
sures. We first show its existence and obtain a familiar expression 
in terms of entropy and relative energy for a class of "almost Gibb- 
sian measures" (almost sure continuity of conditional probabilities). 
For quasilocal measures, we obtain a full variational principle. For 
the joint measures of the random field Ising model, we show that 
the weak Gibbs property holds, with an almost surely rapidly decay- 
ing translation-invariant potential. For these measures we show that 
the variational principle fails as soon as the measures lose the al- 
most Gibbs property. These examples suggest that the class of weakly 
Gibbsian measures is too broad from the perspective of a reasonable 
thermodynamic formalism. 

1. Introduction. Since the discovery of the Grifnths-Pearce singularities 
of renormalization group transformations [8, 28], a challenging question has 
been whether the classical Gibbs formalism can be extended in such a way 
as to incorporate renormalized low-temperature phases, so that renormal- 
izing the measure can really be viewed as a transformation on the level of 
Hamiltonians. Later on, many other examples of "non-Gibbsian" measures 
appeared in the context of joint measures of disordered spin systems [13], 
time evolution of Gibbs measures [27] and dynamical systems [18], providing 
further motivation for the construction of a generalized Gibbs formalism. 

As soon as the first examples of non-Gibbsian measures appeared, Do- 
brushin proposed a program of "Gibbsian restoration of non-Gibbsian fields," 
arguing that the phenomenon of non-Gibbsianness is caused by "excep- 
tional" configurations which are negligible in the measure-theoretic sense. 
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He thus proposed the notion of a "weakly Gibbsian" measure, where the ex- 
istence of the finite-volume Hamiltonian is not required uniformly in the 
boundary condition, but only for boundary conditions in a set of mea- 
sure 1. This is clearly enough to define the Gibbsian form of the conditional 
probabilities and Gibbs measures via the DLR equations. Since Dobrushin 
and Shlosman [4], many articles have shown the "weak Gibbs" property of 
renormalized low-temperature phases (see e.g., [3, 17, 19, 21]) and of joint 
measures of disordered spin systems [13, 14]. Parallel to this, Fernandez 
and Pfister [6] developed ideas about generalized regularity properties of 
the conditional probabilities. They proved that the decimation of the low- 
temperature plus phase of the Ising model is consistent with a monotone 
right-continuous system of conditional probabilities. In the framework of 
investigating the regularity of the conditional probabilities, the notion of 
"almost Gibbs" was introduced [19]. A measure fi is called almost Gibbs 
if its conditional probabilities have a version which is continuous on a set 
of //-measure 1. If one does not insist on absolute convergence of the sums 
of potentials that constitute finite-volume Hamiltonians, then almost Gibbs 
implies weak Gibbs, but the converse is not true (see [15, 19]). In [5] it was 
proved that the decimation of the plus phase of the low-temperature Ising 
model is almost Gibbs, and the criterion to characterize an essential point 
of discontinuity of the conditional probabilities given in [28] strongly sug- 
gests that many other examples of renormalized low-temperature phases are 
almost Gibbs. The investigation of generalized Gibbs properties of the non- 
Gibbsian measures which appear, for example, as transformations of Gibbs 
measures, is called the first part of the Dobrushin program. 

The second part of the Dobrushin program then consists of building a 
thermodynamic formalism within the new class of "generalized Gibbs mea- 
sures." The question of whether, in the context of weakly Gibbsian measures, 
there is a reasonable notion of "physical equivalence," that is, if two systems 
of conditional probabilities share a Gibbs measure, then they are equal, al- 
ready was raised [3]. In the classical Gibbs formalism, physical equivalence 
corresponds to zero relative entropy density, or zero "information distance." 
Generally speaking, one would like to obtain a relationship between vanish- 
ing relative entropy density and conditional probabilities. For Gibbs mea- 
sures with a translation-invariant uniformly absolutely convergent potential, 
a translation-invariant probability measure \i has zero relative entropy den- 
sity h{p\v) with respect to a Gibbs measure v if and only if fj, is Gibbs with 
the same potential. Physically speaking, this means that the only minimizers 
of the free energy are the equilibrium phases. In complete generality (i.e., 
without any locality requirements), h{fj\v) = does not imply that \i and 
v have anything in common; see, for example, the example in [31], where a 
measure v is constructed such that for any translation-invariant probability 
measure, h{p\v) = 0. 
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In this article we investigate the relationship between h{jj\v) = and the 
property of having a common system of conditional probabilities for general 
quasilocal measures, almost Gibbsian measures and weakly Gibbsian mea- 
sures. We work in the context of lattice spin systems with a single-site spin 
taking a finite number of values. Let 7 denote a translation-invariant system 
of conditional probabilities and let Gmvd) denote the set of all translation- 
invariant probability measures having 7 as a version of their conditional 
probabilities. If 7 is continuous, then, for v G Qmv{l)i we obtain h(n\v) = 
if and only if [x G Gmv(l)- If 7 is continuous \x almost everywhere, then we 
obtain that h(p\v) = and v G Gmvil) implies /i G Gmvil)- More generally, 
for v G <7i nv (7) and fi a probability measure, concentrating on a set of "good 
configurations," we obtain the existence of an explicit expression 

for it where v enters only through its conditional probabilities and the re- 
lationship h(n\is) = implies /i G Ghiv{l)- The good configurations here are 
defined such that a telescoping procedure — inspired by the method of Sul- 
livan [26] — converges almost surely. These results, together with some ex- 
amples of non-Gibbsian measures to which they apply, suggest that almost 
Gibbsian measures exhibit a reasonable thermodynamic formalism. The fact 
that some concentration properties of the measures are required is reminis- 
cent of the situation in unbounded spin systems [24], an analogy already 
pointed out by Dobrushin. 

The context of joint measures of disordered spin systems provides a good 
source of examples for validity and failure of the relationship between h{ii\v) = 
and /j, G Gmvil)- Here by joint measure we mean the joint distribution of 
both the spins and the disorder. In these examples (especially for the ran- 
dom field Ising model) there is a precise criterion that separates the almost 
Gibbsian case from the weakly Gibbsian case. In particular, for the random 
field Ising model, the joint measure is always weakly Gibbs, and at low tem- 
peratures we prove here that it even admits a translation-invariant potential 
which decays almost surely as a stretched exponential (so in particular con- 
verges absolutely a.s.). If there is no phase transition, then the joint measure 
for the random field Ising model is almost Gibbs (but not Gibbs in dimen- 
sion 2 at low temperature). In the almost Gibbsian regime we obtain the 
validity of the relationship between h{[i\v) = and (i G Gmvi""/), whereas in 
the weakly but not almost Gibbsian regime we show its invalidity. More 
precisely, in that case the joint measure for the minus phase (K~) is not 
consistent with the (weakly Gibbsian) system of conditional probabilities of 
the plus phase (K + ), but one easily obtains that the relative entropy den- 
sities h{K~\K + ) = h(K + \K~) = 0. Physically speaking, this means that we 
are in the pathological situation where a minimizer of the free energy is not 
a phase (in the DLR sense). At the same time, we also treat the joint mea- 
sures in a very broad sense, that is, for possibly non-i.i.d. disorder, we prove 
the existence of relative entropy density, give an explicit representation in 



4 



CH. KULSKE, A. LE NY AND F. REDIG 



terms of the defining potentials and discuss implications of our results for 
the Morita approach [22]. 

Our article is organized as follows: in Section 2 we introduce basic defi- 
nitions and notation, discuss the different generalized Gibbs measures and 
define the variational principle. In Section 3 we prove a formula for the rel- 
ative entropy density for some class of almost Gibbsian measures using the 
technique of relative energies [26] . This formula is then applied to prove the 
implication "fj, and v Gibbs with the same specification implies h{p\v) = 0" 
for that class of measures. In Section 4 we prove the full variational principle 
in our terminology (i.e., in the sense of Definition 2.11) for measures with a 
translation- invariant continuous system of conditional probabilities. In Sec- 
tion 5 we give as examples the GriSing random field and the decimation of 
the low-temperature plus phase of the Ising model. In Section 6 we discuss 
examples of joint measures of disordered spin systems. 

2. Preliminaries. 

2.1. Configuration space. The configuration space is an infinite product 
space = E I ' d with E a finite set. Its Borel u-field is denoted by T . We 
denote by S = {A C Z d , |A| < oo} the set of the finite subsets of Z rf and 
for any A £ S, Q\ = E . We let Ts. denote the a algebra generated by 
{cr(x) : x G A}. For all a, to E fl, we denote cj a the projections on Qa and 
also write cr^u>\c for the configuration which agrees with a in A and with u in 
A c . The set of probability measures on (O, T) is denoted by A4f. A function 
/ is said to be local if there exists A £ S such that / is .T-A-measurable. We 
denote by C the set of all local functions. The uniform closure of C is C(fi), 
the set of continuous functions on 17. 

On O, translations {t x : x € Z d } are defined via (r x u>)(y) = u>(x + y), and 
similarly on functions T x f(u>) = f{r x oj) and on measures / / d,T x fi = J (r x f) dfi. 
The set of translation- invariant probability measures on f2 is denoted by M\ in 

We also have a partial order r\ < £ if and only if for all x £ r](x) < ((x). 
A function / : f2 — > R is called monotone if rj < £ implies f(rj) < /(C)- This 
order induces stochastic domination on A4f: \i ^ v if and only if fJ,(f) < v(f) 
for all / monotone increasing. 

2.2. Specification and quasilocality. 

Definition 2.1. A specification on (Q,J r ) is a family 7 = {7A, A € 5} 
of probability kernels from to T that are proper and consistent. 

1. Proper: For all B G JF A c, Ja{B\oj) = 

2. Consistent: If A C A' are finite sets, then 7a'7a = 7A'- 
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The notation 7a'7a refers to the composition of probability kernels: for 
A G T, u G fi, 



(lA'TA) (A\u) = / ja(A\uj')ja>(cIuj'\uj). 
Jn 

These kernels also act on bounded measurable functions /, 

7a/(w)= / f(a)j A (da\u), 

and on measures //, 

M7a(/) = y /^7A = y (7a/) d/i- 

A specification is a strengthening of the notion of a system of proper regular 
conditional probabilities. Indeed, in the former, the consistency condition 
(item 2) is required to hold for every configuration u G fi, and not only 
for almost every (j£fi, This is because the notion of specification is de- 
fined without any reference to a particular measure. A specification 7 is 
translation- invariant if for all A G J 7 , A G 5, wed, 

ja +x (A\uj) =^a{t x A\t x ui). 

In this article we always restrict to the case of nonnull specifications, that 
is, for any A G S, there exist < a a < 6 a < 1 such that 

a A < inf 7A0|r?) < sup7 A ((r|r/) < b A - 

<r,V a,ri 



Definition 2.2. A probability measure f/, on (f2, F) is said to be con- 
sistent with a specification 7 (or specified by 7) if the latter is a realization 
of its finite- volume conditional probabilities, that is, if for all A G T and 
A G S, and for /i-a.e. cj, 



(2.1) ii[A\FAc](u)=>y A (A\u). 

Equivalently, fi is consistent with 7 if 

y (lAf)d(J, = y /d/i 

for all / G C(f2). We denote by ^(7) the set of measures consistent with 7. 
For a translation- invariant specification, Ginvij) is the set of translation- 
invariant elements of £(7). 

Definition 2.3. 1. A specification 7 is quasilocal if for each A G S and 
each / local, 7a/ G C(O). 

2. A probability measure /i is quasilocal if it is consistent with some 
quasilocal specification. 
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2.3. Potentials and Gibbs measures. Examples of quasilocal measures 
are Gibbs measures defined via potentials. 

Definition 2.4. f. A potential is a family = {&a'-A € S} of local 
functions such that for all A € S, §a is .^-measurable. 

2. A potential is translation-invariant if for all A £ S, x € Z d and to € f2, 

<S> a+x (lu) = <S> a (t x uj). 

Definition 2.5. A potential is said to have the following attributes: 

1. Convergent at the configuration u> if for all A € S, the sum 
(2.2) $ AM 

is convergent. 

2. Uniformly convergent if convergence in (2.2) is uniform in oj. 

3. Uniformly absolutely convergent (UAC) if for all A £ <S, 

^2 sup|$aM| < oo. 

For a general potential $, we define the measurable set of its points of 
convergence as 

f]$ = {w£!l: ( f is convergent at u>}. 

To define Gibbs measures, we consider a UAC potential and define its 
finite-volume Hamiltonian for As5 and boundary condition u € £1 by 

#*(o-|u;)= ^a(o-a^ac). 

AnA^0 



Definition 2.6. Let <3? be UAC. The Gi&frs specification 7* with po- 
tential $ is defined by 

^aV) 

where the partition function Z*(l<j) is the normalizing constant. 

A measure /i is a Gibbs measure if there exists a UAC potential $ such 
that /i 6 <7(7*). Gibbs measures are quasilocal; conversely, any nonnull quasilo- 
cal measure can be written in a Gibbsian way (see [10] and more details in 
Section 4). 
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2.4. Generalized Gibbs measures. 

Definition 2.7. A measure v is weakly Gibbs if there exists a potential 
$ such that 1/(0$) = 1 and 

^a( w ) 

for i/- almost every cj. 

Remark 2.8. Some authors insist on the almost surely absolute con- 
vergence of the sums defining Hf. However, for the definition of the weakly 
Gibbsian specification there is no reason to prefer absolute convergence. 

Definition 2.9. Let 7 be a specification. A configuration uj is said to 
be a point of continuity for 7 if for all A & <S, / G C, j^f is continuous at u. 

For a given 7, J7 7 denotes its measurable set of points of continuity. 

Definition 2.10. A measure v is called almost Gibbs if there exists a 
specification 7 such that v € ^(7) and z/(fi 7 ) = 1. 

If v is almost Gibbs, then there exists an almost surely convergent poten- 
tial <E> such that v is weakly Gibbsian for <J> and thus almost Gibbsianness im- 
plies weak Gibbsianness. The converse is not true: A measure can be weakly 
Gibbs and for the associated potential 7 $ is of measure zero [15, 19]. If 
a measure is almost Gibbs and translation-invariant, then the corresponding 
potential can be chosen to be translation- invariant. 

2.5. Relative entropy and variational principle. For fi, v £ M-X\w ^ ne 
finite-volume relative entropy at volume A € S of [i relative to v is defined as 

(2-3) MH") = \Ld^ log d^ d ^ lf ^«^< 

[ +00, otherwise. 

The notation fi\ refers to the distribution of u>\ when uj is distributed ac- 
cording to fi. By Jensen's inequality, h\(fj,\u) > 0. The relative entropy of fi 
relative to v is the limit 

(2.4) h{ji\v)= lim -jL-hAnOilv), 

n 00 \^n\ 

where A n = [n,n] <: ' n Z d is a sequence of cubes (this can be replaced by a 
Van Hove sequence). In what follows, if we write lim^ Z d f(A), we mean 
that the limit is taken along a Van Hove sequence. The defining limit (2.4) 
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is known to exist if v G M.X imr is a translation-invariant Gibbs measure 
with a translation-invariant UAC potential and /i G 5 arbitrary. The 
Kolmogorov-Sinai entropy h(fi) is defined for ,u G -M^ inv as 



We are now ready to state the variational principle for specifications and 
measures, which gives a relationship between zero relative entropy and equal- 
ity of conditional probabilities. 

Definition 2.11 (Variational principle). Let 7 be a specification, v G £?mv(7) 
and M. C Mf inv . We say that a variational principle holds for the triple 
(~f,u,M) if 

0. h(fj,\u) exists for all /1 G .M; 

1- A* € <?inv(7) n A4 implies /i(H^) = 0; 

2. = and fi £ A4 implies /1 G <5inv(7)- 

Items 1 and 2 are called the first and second part of the variational princi- 
ple. The second part is true for any translation-invariant quasilocal measure 
v [7] (with M = A4^ inv ). The first part is proved for translation-invariant 
Gibbs measures associated with a translation-invariant UAC potential (with 
M. = A^ inv also). We extend this result to any translation-invariant quasilo- 
cal measure in Section 4. In [5], the second part was proved for some renor- 
malized non-Gibbsian FKG measures. In general, the set M will be a set of 
translation-invariant probability measures that concentrate on good config- 
urations (e.g., points of continuity of conditional probabilities). 

3. Variational properties of generalized Gibbs measures. We study the 
variational principle — in the sense of Definition 2.11 — for generalized Gibbs 
measures. We first prove the second part for almost Gibbsian measures, 
which is a rather straightforward technical extension of [7], Chapter 15. 

3.1. Second part of the variational principle for almost Gibbsian measures. 

Theorem 3.1. Let 7 be a translation-invariant specification on 
and v G £w(7)- For M ^ G Mf inv , 



(2.5) 



h(fi) = - lim j— 
n— 00 I A, 



71 



^/i(o- A Jlog/i(o- An ). 




and thus such a measure fi is almost Gibbs w.r.t. 7. 
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Proof. Choose v € Ginv(l) and fj, such that h(fi\u) = 0. We have to 
prove that for any g £ C, A G 5, 

(3-1) //(7A5 - 5) = 0. 

Fix g € £ and A € S such that 5 is .T-A-measurable. The hypothesis 

(3.2) h(^)=\imj-h(fi\u)=0 

A^Z d \A\ 

implies that for every A G 5, the density f\ = dpi A /dv\ exists and is a 
bounded positive .FA-measurable function. Introduce local approximations 
of 7a#: 

g~(a) = inf 7a5(^a„wa=), 
g+(a) = sup7A5(o-A„w A c ). 

In the quasilocal case, we have g^ — g~ — > uniformly when n goes to infinity, 
whereas here we have <?+ — g~ — > on the set fi 7 of /U-measure 1 and, hence, 
by dominated convergence in L 1 (/i). To obtain (3.1) decompose 

(3.3) n(-f A g -g) = A n + B n + C n + D n , 
where 

A n = KlAg - 9n)i 
B n = v((9n -7A5)/a„\a), 
Cn = ^(/A„\A(7A5'-5 , )), 
D n = v{(fA n \A- fAn)9)- 

Using 

0<7AS--S„" <5n -5n» 

^4 n — > as n goes to infinity. For B n , use 

< \B n \ = u((j A g - 5n )/A„\A) < ^(/A„\A(5n ~ 9n)) = MSn ~ 0») 

to obtain B n — > as n — ► 00. 

Since z/ € £(7) and /a„\a G ^vv c 5 C n = 0. The fact that D n — ► follows 
from the assumption of zero relative entropy density (see [7] , page 324) . □ 

Remark 3.2. 1. The role of M in Definition 2.11 is played here by the 
set of measures that concentrate on the points of continuity of 7 [fi E M if 
and only if /u(0,y) = 1]. 

2. Note that in Theorem 3.1, we do not ask any concentration properties 

of v. 
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3.2. Relative entropy density for some almost Gibbsian measures. To ob- 
tain a relationship between \i £ £(7) and h{p\v) = — the first part of the 
variational principle — it turns out that concentration of (i on the set of points 
of continuity of 7 is not enough. In fact, we need some particular class of 
"telescoping configurations" to be points of continuity of the specification. 
This is reminiscent of asking for continuity properties of the one-sided con- 
ditional probabilities. In the case of (uniformly) continuous specifications, 
this distinction between one-sided and two-sided probabilities is, of course, 
not visible. 

We choose a particular value written +1 in the state space E and denote 
by + the configuration whose value is +1 everywhere. We use a telescoping 
procedure with respect to this reference configuration. It is important that 
the reference configuration be translation-invariant; hence, our choice of "the 
all + configuration" is not restrictive. In Section 3.4, we generalize to a 
telescoping configuration chosen from a translation-invariant measure: this 
will be important in Section 6. 

To any configuration (r£fl, we associate the configuration o~ + defined by 



Here, the order < is lexicographic. We define then to be the subset 
of Q of the configurations a such that the new configuration o~ + is a good 
configuration for 7: 



This set is described in different examples in Section 5. 

3.2.1. Results. We consider a pair (7,^) with v £ Ginvil) an d a measure 
fj, which satisfies the following condition: 

Condition CI. 




if x < 0, 
if x > 0. 




{cr £ Q, a £ Q-y}. 



/i(0<°) = l. 



We also introduce the ^-specific energy of the plus state, 




whenever it exists. 



Theorem 3.3. Under Condition CI: 
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1. If and only if exists, h{^\v) exists and then 

(3.4) hSji\v) = -h{n) + e+ - / log l^Q^l^da), 

Jn 7o + \o- + ) 



where h(fj,) is the Kolmogorov- Sinai entropy of [i. 
2. If, moreover, fx G Qmv{l) o,nd e+ exists, then 

(3.5) h(p\u)= lim -i-log-^™ 



A|Z d |A| ^(+a) 



To obtain a result which is more reminiscent of the first part of the varia- 
tional principle in the standard theory of Gibbs measures, we add an extra 
condition to Condition CI: 



Condition C2. 

(3.6) P'^Qmvi'y) is such that lim —— log ^~*~ A ^ = o, 

Afz d |A| zv(+ A ) 



Theorem 3.4. Assume that Conditions CI and C2 are true. Then: 

1. h(/i|z/) = 0; 

2. e+ exists and e+ = e+; 

3. /i(a|i/) exists for all a € A4^~ inv satisfying Condition CI. 



Remark 3.5. In the standard theory of Gibbs measures, the existence 
of h(fi\u) and the identity (3.4) are obtained by proving existence and bound- 
ary condition independence of the pressure. This requires the existence of 
a UAC potential, which in our case is replaced by regularity properties of the 
specification and existence of the limit defining ejj~ . The existence is guaran- 
teed, for example, for renormalization group transformations of Gibbs mea- 
sures and for v with positive correlations (by subadditivity) . Moreover, in 
the case of transformations of Gibbs measures, Condition C2 is also easy to 
verify (see Section 5). However, showing existence and boundary condition 
independence of the pressure is highly nontrivial in this context. 



Remark 3.6. A consequence of Theorem 3.3 is that the ^-specific en- 
ergy e+ exists if v satisfies Condition CI. This is a consequence of the 
existence of h(y\v) (= 0) and point 1 of this theorem for the particular 
choice ii = v. 
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3.3. Proofs. First we need the following lemma. 

Lemma 3.7. If = 1, then the following statements are valid: 

1. Uniformly in u G ^, 

2. For v& Gin), 



lim -L / log 4^4^-)= / log^T^M^)- 
In particular, the limit depends only on the pair (7, /x) . 

Remark 3.8. If /U is ergodic under translations, we have a slightly 
stronger statement for item 1: (l/|A n |) f n log((7A(a|w))/7A(+|u;))^(d<7) con- 
verges in L 1 (/x) to /^log((7o((T + |o' + ))/7o(+|cr + ))/x((io"), uniformly in w £ O. 

Proof of Lemma 3.7. 1. The proof uses relative energies as in [26]. 
For all A G S, a, u G fl, we define 

17+/ 1 \ 1 Ta(o-|w) + . . 7o(o"k) 

^ (fT| " )=log 7Av+M ^ ((T) = ii; w (cj|cj) = log ^(TH- 

We consider an approximation of cr + at finite volume A with boundary 
condition to and define the telescoping configuration T%[x,o~,+]: 

(u(y), ifyGA c , 
T£[x,o-,+](y) = l a(y), if y < x, y G A, 
[+1, ifyx, yGA. 

Using the consistency property of 7, we have, by telescoping, 
(3.7) E+(a\u) = E+(a\Tnx,a,+]). 

To see this, denote A< x = {y G A : y < x}, A <x = A< x \ {x} and A >x = A \ 
A< x . Let A = {x\, . . . , xn} denote an enumeration of A in lexicographic 
order. Then we can write, using consistency, 

j A {a\uj) _ jL 7A(gA< a . +\ >Xi \w) 
7a(+|w) fJi 7a(cta<^_ i +a >x% _, M 

(3.8) 

_ yr lxMxMk <Xl +A >Xi ^A°) 
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Taking the logarithm yields (3.7). By translation invariance of 7, 
E+(a\oj) = J2D(r. x Tnx,a,+]). 

By translation invariance of fi, 

j E+ n (a\u;)fM(da) = ]T / D(T- x Tf[x,T x <T,+])ii(da). 

Therefore, we have to prove that, uniformly in u, 

lim -L( I [D(r^T^[x,T x a,+])-D(a + )Uda)) = 0. 



By definition, 

T- x Tj( n [x,T x a, +] 



r- x u(y), ify + xGA^, 

+, if 0<y, y + x£ A n , 

<?{y), if y<0, y + x£ A^. 



Now, pick e > 0, to £ Q and a € r^<°. Using the fact that a + is a point of 
continuity of D, we choose no such that £|a„ = 0" + |a„ o implies \D(£) — D(a + ) \ < e. 
We remark that T- x T£ n [x, r x a, +] and cr + differ only on the set {y 6 Z rf : x + 
y € A^}. Therefore, the difference \D(a + ) — D(t- x T% [x,t x <j,+])\ can only 
be greater than e for x such that (A no -i)nAjj/0. Therefore, 



(3.9) 



I An I 



[D(T- x T£ n [x,T x a,+})-D(a+)} 

xGA n 



<e + 2||L>| 



|{a;gA n :(A no -x)nA^0}| 
|A„| 



and this is less than 2e for n large enough. So we obtain that 
Y, [D(r. x TX n [x,r x a,+])-D(a + )] 

x£A n 



\A r . 



converges to zero on the set of of full ^t-measure, uniformly in u. By 
dominated convergence, we then obtain 



lim sup — — - [ 

w |A n | Jn 



Y [D(r^ x Tnx,r x a,+])-D(a + )] 



fj,(da) = 0, 



which implies statement 1 of the lemma. 
2. Denote 

1 



An I Jn K+A„ 



14 CH. KULSKE, A. LE NY AND F. REDIG 

Using v £ Q{ci)s w e obtain 

F A n 0, V) 

Use 



1 



/ | \ _ r / I \ / 7 \ _ Slip . in' 

Let e > be given and u = u(n,o~,e), uj' = u'(n,a,e) such that 



/ inflog^#W)>/log 



7A n (<7|^(^,Q-,e)) 
7A„(+|w(n,cr,e)) 



and 



S2^ 7A n ( + |w) 

7A„(cr|o;) 

sup log w ; ; 

Now use the first item of the lemma and choose N such that for all n> N, 
1 



sup 



|A n |7n 7A„(+|w) 
For n> N, we obtain 



'fi 7A n (+|o; / (n,cr,e)) 
e N such thi 

L>(fj + )/i(d(r) 



log ^"U dv 



<£. 



[ D{a + )n(da) -2e< F An {fi\u) < [ D(a + )fi(da) + 2e. 
Jn Jn 

M CT A„) 



□ 



Proof of Theorem 3.3. 1. Denote 

1 



h n (n\v) :-- 



l A n| 



M^An) lOg 



^(<7A„ 



We recall that for /x G A/^ inv (ft), the limit of /i n (/i) := -(l/|A n |) /x(cr An ) x 
log/i(o"A n ) is the Kolmogorov- Sinai entropy of denoted h(fi). We write 

1 



(3.10) h n {ii\v) = -hn(fi) 



2_, m(^a J log- 



O'At, 



I An 



logl/(+ An ). 



When Condition CI holds, the asymptotic behavior of the second term of 
the right-hand side is given by Lemma 3.7. Hence, the relative entropy exists 
if and only if e+ exists, and it is given by (3.4). 

2. We consider [i £ Q\nv{l) such that /i(f2<°) = 1 and use the following 
decomposition of the finite-volume relative entropy: 

hn(ji\ v ) = -nrr K^aJ log 



I An I 



(3.11) 



ff A„ 



M(+A„) 



|A 



1 V- / m K°aJ 1 , A t (+A„) 
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By Lemma 3.7, in the limit n — > oo, the first two terms on the right-hand 
side are functions of 7 rather than functions of fi, v € Gmv(l) arid cancel out. 
Hence, the relative entropy exists if and only if the third term converges. 
Using item 1 (existence of relative entropy), we obtain the existence of the 
limit (3.5) and the equality 

h{p\v)= lim -^log M+Aj 



n-»oo|A n | K+A«)' D 

Proof of Theorem 3.4. 1. Start from the decomposition (3.11). For 
ji and v in G(j), under Condition CI, in the limit n — > 00, the first two 
terms on the right-hand side cancel (see Lemma 3.7), and we obtain, by 
Condition C2, 

(3.12) = lim -L log 4^ = h(ji\u). 

2. Now consider the decomposition (3.10). From (3.12), we obtain h([i\v) = 
0; hence, by Lemma 3.7, e+ exists and is given by 

e+ = h{n)+ /log 7o( ^ k + +) M^)- 
J 7o(+F + ) 

Existence of e+ and the equality e+ = e+ now follows trivially from Condi- 
tion C2 and existence of e+. 

3. Consider any other measure a € -A^^" inv such that Condition CI holds. 
The existence of the relative entropy h(a\n) follows by combining the exis- 
tence of e+ with Theorem 3.3, and 

h{a\v) = -h(a) + e+ - / log 7 °^" }° J a(da). n 

J 7o(+F + ) u 

3.4. Generalization. In the hypothesis of the theorems above, the plus 
configuration plays the particular role of a telescoping reference configura- 
tion. Without too much effort, we obtain the following generalization where 
we telescope w.r.t a random configuration £ chosen from some translation- 
invariant measure A. Results of the previous section are recovered by choos- 
ing A = £+. The generalization to a random telescoping configuration will 
be natural in the context of joint measures of disordered spin systems in 
Section 6. 

For any £,cr £ fi, we define the concatenated configuration a^, 

cr(x), if x < 0, 



(3.13) VieZ d , (T f (x) = | 



£(x), ifx>0, 



and the set f^' <0 to be the subset of f2 x Q, of the configurations such 
that the new configuration is a good configuration for 7: 

Qt><° = {((7,0 G J) x n, a 5 6 7 }. 
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We also generalize the specific energy e+ and denote 

(3.14) e x u = - lim ±- f ]ogv(U)\(d£) 

A|Z d |A| Jq 

provided this limit exists. 

We consider a specification 7, measures v G Ginvil) and /i, A € -Mf inv , and 
the following conditions: 

Condition CI'. We have A <g> fi(^ <0 ) = 1. 

Condition C2'. We have lim ATZ d 4r J Q log(d//A/^A)(£A)A(d£A) =0. 

The following theorems are the straightforward generalizations of Theo- 
rems 3.3 and 3.4, respectively, and their proofs follow the same lines. 

Theorem 3.9. Under Condition Cl': 

1. If and only if e x exists, h(/j,\u) exists and then 

(3.15) h(ji\u) = -h(jj) + e x v - f log 7o( ° 'J°?. K (da)X(dO- 

2. //, moreover, \i G <?i nv (7) and e x exists, then 

hW)= lim T^T / log^(a)AK A ). 
ATZ d |A| Jn az> A 

Theorem 3.10. // \x,v e £(7) are suc/i i/iai Conditions Cl' and C2' 
are fulfilled, then: 

1. h(/i|i/)=0; 

2. e^ exists and equals e x ; 

3. /i(a|z^) exists for all a € Mf inv satisfying Condition Cl'. 

4. Variational principle for quasilocal measures. The usual way to prove 
H £ Ginvil) h(fj,\u) = in the Gibbsian context uses that 7 is a speci- 
fication associated with a translation-invariant and UAC potential <£, and 
proceeds via existence and boundary condition independence of pressure 
(see [7]). Since for a general quasilocal specification 7, we cannot rely on 
the existence of such a potential (see [10] and the open problem in [28]), we 
show here that the weaker property of uniform convergence of the vacuum 
potential, which can be associated to the quasilocal specification 7 (see [10]), 
suffices to obtain zero relative entropy. 
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Theorem 4.1. Let 7 be a translation-invariant quasilocal specification, 
v £ £?inv(7) an ^ M ^ -^linv Then h{^\v) exists for all \i G M.f inv and 

MG£inv(7) /i(/u|^) = 0. 

Proof. The implication of the left-hand side (the second part) is proved 
in [7]. To prove the first part, we need the following lemma to check the 
hypothesis of Theorem 3.4. Condition C2 is trivially true when 7 is quasilocal 
(fi<° = n). 

Lemma 4.2. For all ^,!/£ Gmvi^f) with 7 translation-invariant and quasilo- 
cal, e+ , e+ exist and 

r 1 , M(+A„) n 
hm r- — r log — = 0. 

n^oo |A n | Z/(+A„) 

PROOF. Kozlov [10] proved that to any translation-invariant quasilocal 
specification 7 there corresponds a translation-invariant uniformly conver- 
gent vacuum potential such that 7 = 7*. 

By uniform convergence, we have 



(4.1) lim sup 



A3O,AnA c ^0 



0. 



Note that in (4.1) the absolute value is outside the sum, that is, (4.1) means 
that the series J2a^o ^a(o") is convergent in the sup-norm topology on C(O), 
but not necessarily absolutely convergent. We can define a Hamiltonian and 
a partition function for any A 6 S, rj, a £ Q, as usual: 

(4.2) #>)= £ M^at/ac) and Za(w) = £ e^W. 

Lemma 4.2 is now a direct consequence of the following lemma. 
Lemma 4.3. 

( 4 - 3 ) Jl™ su p irri^L (") - w 1 = o; 

(4.4) lim sup -L log §^ = 0. 



Proof. We follow the standard line of the argument used by Israel [9] 
to prove existence and boundary condition independence of the pressure 
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for a UAC potential, but we detail it because the vacuum potential is only 
uniformly convergent. Clearly, (4.3) implies (4.4). For all n £ N, 

exp { - sup \H\ n (a) - H% n (a) \ } < sup 

<exp\ S up\HZ n (a)-H% n (a)\). 

To prove (4.3), we write 



HUa)-H% n (a) 



and we first note that 



E [$A{(TAjlA- n ) ~ <Mo-A„w A c )], 

AnA n ^0,AnA=^0 



I A, 



E [^(ffA„^)-$^(ffA„WA^)] 

AnA n ^0,AnA=^0 



< 



I An I 



E 



sup 



xeA r , 



We obtain 
sup 



E *xw 

A3a;,AnA^^0 



sup 



sup 



E M*) 

A3a;, J 4nA=^0 



E $ aW - E 

A3x A3x,AcA n 



Y $a(t x ct) - Y ®a(t x (t] 
AbO AB0,Ac(A n -x) 



< sup 

Pick e > and choose A such that 



E M£) 

A3O,An(A n -x) c ^0 



sup 

f 



E mo 

A9O,AnA c ^0 



<e. 



Then 



where 



E <M0 

A3O,An(A n -x) c ^0 



< 



e, if (A n - x) D A, 

C, if (A n -x)nA c ^0, 



C = sup 

C 



A90 



< (X). 
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Since for any A C Z d finite, 



Inn e l{*:A + ,nA^0}| =O| 

n->oo A„ 



we obtain 



lim sup T^— J- E SU P 



E MO 

x3a;,AnA£^0 



which by the arbitrary choice of e > proves (4.3) and the statement of 
the lemma. 

□ 



To derive Lemma 4.2 from Lemma 4.3, we have to prove only that for all 
v £ Gmv(l), &t exists and is independent of 7. For such a measure u, write 



K+a)= / — — 7-^ u { dr i), 



In Z An (r]) 

where H\ is defined via the vacuum potential of 7 in (4.2). We use Lemma 4.3 
to write 



K+a) 



n Zf 



-v(drj) 



where a a = 6a means limA(l/|A|)| log(aA/&A)| = 0. Since $ is the vacuum 
potential with vacuum state +, H a ~(+a) = and hence 



E ex p - E M<0 

.o-efiA \ AcA 



where Z^ (resp. Z A VCC ) is the partition function with the + (resp. free) 
boundary condition, which in our case coincide. Fix R > and put 

<b^(n\ — / if diam (^) ^ R > 

{ > " \ 0, if diam(A) > ij. 

Then, using the existence of pressure for finite range potentials (cf. [9]), 

lim X\ log Zi ree ($ (jR) ) : =P($( fi )) exists. 
a |A| 



Now use 



log ^ eX P(-^cA^)) 

E CT exp(-£ AcA <^V)) CT 



E <M*) 

AcA,diam(A)>_R 
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a xGA A9z,diam(A)>i? 

<^sup ]T ^ A (c) 

x€A a A3x,diam(A)>i? 

|A|sup ^ $ A (a) 

A30,diam(A)>.R 



and 



E CT exp(-EAcA^A ) H) 



< |A|sup 



A90,diam(A)>i?Ai?' 



E.expl-EAcA^? ^)) 
to conclude that {P(^),R > 0} is a Cauchy net with limit 



R 



lim P($( fl ))= lim -j-logZ A ree = e+ 



which depends only on the vacuum potential (hence on the specification 7). 
This proves that e+ and e+ exist for all <?inv(7), and depend on 7 

only. Therefore, 



0+ 



0+ 



0. 



which proves Lemma 4.2. □ 



A direct consequence of this lemma is that in the framework of The- 
orem 4.1, e+ exists and Conditions CI and C2 are true. We obtain the 
theorem by applying Theorem 3.4. □ 

5. Examples. 

5.1. The GriSing random field. The GriSing random field is an example 
of joint measure of disordered systems, studied more in Section 6. It was 
studied in [30] and provides an easy example of a non-Gibbsian random 
fields which fits in the framework of our theorems. The random field is 
constructed as follows. Sites are empty or occupied according to a Bernoulli 
product measure of parameter p <p c , where p c is the percolation threshold 
for site percolation on Z, d . For any realization 77 of occupancies where all 
occupied clusters are finite, we have the Gibbs measure on configurations 

ae{-l,+l} zd , 



^(da) 
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which is the product of free boundary condition Ising measures on the oc- 
cupied clusters. More precisely, under f/L spin configurations of occupied 
clusters, C are independent and distributed as 

t*p,c( a c) = T^exp(/3 a ( x ) a (y) J ■ 
Za V {xvK c J 

The GriSing random field is then defined as 

= a{x)rj{x). 

In words, £(x) = for unoccupied sites and equals the spin a(x) at occu- 
pied sites. 

We denote by K p p the law of the random field £. It is known that for 
any p€ (0,1), large enough, K p $ is not a Gibbs measure (see [30] for 
p < p c and [13] for any p G (0, 1)). The points of essential discontinuity of 
the conditional probabilities K p ^(a(0)\^ Ii d\^) are a subset of 

D = contains an infinite cluster of occupied sites}. 

Since p < p c , there exists a specification 7 such that {K p> p} = ^(7) and 
such that for the continuity points Q~, we have K p ^{Q,^) = 1, that is, K p% p 
is almost Gibbs. Moreover, if we choose (0 = as a telescoping reference 
configuration, then clearly a G D c implies G D c , that is, in this case, 
7 C f2^°. Therefore, in this example Condition CI is satisfied as soon as \i 
concentrates on D c . Using {K Pt p} = £(7) and 

lim , TTT 1o S A ^/3(°a) = !og(l -p), 
k\Z d \A\ 

we obtain the following proposition: 

Proposition 5.1. If fi(D) = 0, then h(fi\K Pi p) exists and is zero if and 
only if n = K Pi p. 

5.2. Decimation. Let fit (resp. fi2) be the low-temperature ({3 > (3 C ) 
plus (resp. minus) phase of the Ising model on 7L d . For b G N, ut (resp. i/j) 
denotes its decimation, that is, the distribution of {o"(&x):;e gZ^} when 
a is distributed according to fit (resp. fig)- It is known that vt is not 
a Gibbs measure [28]. In [6] it was proved that there exists a monotone 
specification 7 + (resp. 7") such that vt G <5(7 + ) [resp. u7 G £7(7~)]- In [5] 
it was proved that the points of continuity J7 7 + satisfy ut(Cl^+) = 1, that 
is, z/g is almost Gibbs. The points of continuity of 7+ can be described 
as those configurations if for which the "internal spins" do not exhibit a 
phase transition when the decimated spins are fixed to be 77. For example, 
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the all plus and the all minus configurations are elements of fi 7 +, but the 
alternating configuration is not. 

The first part of the variational principle for (7 + , z/g , A4.) has already been 
proved in [5] (and is direct by Theorem 3.1), with a set M. consisting of the 
translation-invariant measures which concentrate on f2 7 + . Here we complete 
this result by adding a second part: 

Theorem 5.2. For any \x € A4f inv satisfying Condition CI for 7 + : 

1. h(fi\up) exists; 

2. We have the equivalence 

/i€£ inv ( 7 + ) <^ h(ji\u+) = 0. 
We first use a lemma. 

Lemma 5.3. Expressions \x £ G{"f + ) and = 1 imply 

(5.1) Vp Ip^Vp- 

Proof. Consider / monotone. By monotonicity of 7 + [6], for all A G S, 
fdn = [ (~f£f)(uMduj)< ( ( 7 +/)(+) M ( c L,) = (7+/X+). 



Taking the limit A f 1^ and using 7 A (-|+) goes to gives 

J fd»< J fdu+. 

Similarly, using /i(fi 7 +) = 1 and the expression of 7 + in [6], we have 7 + (/) 
7~(/), /x-a.s. and hence 

/ta(/)^>7a/(-) ) 



which gives 

/ /<^> J fdup. n 
The following corollary proves Theorem 5.2 using Theorem 3.4. 

Proposition 5.4. 1. The equality e+ + = — lim A | Z d 4rlogi/J"(+A) ex- 
ists. 

2. For any n £ G("f + ) , 

y 1 , M+a) n 

hm — log — t- = 0. 

atz" |A| i/J(+a) 
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Proof. Statement 1 follows from subadditivity and positive correla- 
tions. Statement 2 follows from stochastic domination (5.1) and 

1 , ^(+A) 1 , Mj(+6A) - 
hm — log — — = lim — log — — = 0, 

AfZ* |A| ^(+a) A|Z d |A| Hp{+bk) 

where, to obtain the last equality, we used that Hp, Hp are the Ising plus 
and minus phases. □ 

Remark 5.5. We conjecture that Condition CI is satisfied for any er- 
godic measure fi G hi dimension d = 2. This means proving that the 

internal spins do not show a phase transition, given a typical configuration 
of \i on b7L d to the left of the origin and all + on b7L d to the right. Fixing 
these decimated spins acts as a magnetic field, pushing the spins on the right 
of the origin into a plus-like phase and the spins on the left of the origin into 
a plus-like or minus-like phase, depending on The location of the inter- 
face between right and left should not depend on the boundary condition in 
d = 2 (no Basuev transition). However, we do not have a rigorous proof of 
this fact. 

6. More examples: joint measures of random spin systems. We consider 
the joint measures of disordered spin systems on the product of spin space 
and disorder space defined in terms of a quenched absolutely convergent 
Gibbs interaction and an a priori distribution of the disorder variables. They 
were treated before [13, 14] and provide a broad class of examples of gen- 
eralized Gibbs measures. A specific example of this, the GriSing field, was 
already considered in Section 5.1. 

First we prove that, for the same quenched potential, the relative entropy 
density between corresponding, possibly different, joint measures is always 
zero. Next we prove in generality that these measures are asymptotically 
decoupled whenever the a priori distribution of the disorder is. The useful 
notion of asymptotically decoupled measures was recently coined by Pfis- 
ter [23] and provides a broad class of measures, including local transforma- 
tions of Gibbs measures, for which the existence of relative entropy density 
and the large deviation principle holds. Using these results, we easily obtain 
existence of the relative entropy density. Next we specialize to the specific 
example of the random field Ising model in Section 6.3. We focus on the 
interesting region of the parameter space when there is a phase transition 
for the spin variables for almost any configuration of disorder variables. Here 
we show on the basis of [14] that the joint plus and the joint minus state for 
the same quenched potential are not compatible with the same interaction 
potential. In [14] it was already shown that there is always a translation- 
invariant convergent potential or a possibly nontranslation-invariant abso- 
lutely convergent potential for the corresponding joint measure. We also 
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discuss this in more detail and sketch a proof on the basis of [14] and the 
renormalization-group (RG) analysis of Bricmont and Kupiainen [2] that 
shows that there is a translation- invariant joint potential that even decays 
like a stretched exponential. This provides an explicit example of a weakly 
(but not almost) Gibbsian measure for which the variational principle fails. 

6.1. Setup. We consider disordered models of the following general type. 
We assume that the configuration space of the quenched model is again as 
detailed in Section 2.1 and we denote the spin variables by a. Additionally 
we assume that there are also disorder variables n = (i] x ) X £Z d that enter 
the game, taking values in an infinite product space (E')^ , where again 
E' is a finite set. We denote the joint variables by £ = (£,x) X £i d = ( a ^ 1 l) = 
(o~x,r]x) X £Z d - ^ wm be convenient later also to write simply (an) to denote 
the pair (a, rf). 

One essential ingredient of the model is given by the defining potential 
= (&A)Acz d > w hich depends on the joint variables £ = (o-,n); 3>^(£) de- 
pends on £ only through £4. We assume that <3? is finite range. When we fix 
a realization of the disorder 77, we have a potential for the spin variables a 
that is typically nontranslation-invariant. We then define the corresponding 
quenched Gibbs specification by Definition 2.6 using the notation 

Al 'J cta 

(6.1) 

x exp - ®A(o- A a zd \ A ,r)) . 

\ A:AnA^0 ) 

To keep the notation simple, we suppressed the symbol on the l.h.s. 
of (6.1). The measures (6.1) are also called more loosely quenched finite- 
volume Gibbs measures. Obviously, the finite-volume summation is over 
a A £E A . 

The second ingredient of the quenched model is the distribution of the 
disorder variables ¥(drj). Most of the time in the theory of disordered sys- 
tems one considers the case of i.i.d. variables, but we can and will be more 
general here. 

The objects of interest then are the infinite- volume joint measures K a (d£), 
by which we understand any limiting measure of lim A ^dW(drj)fJ,^ L [i]](da) in 
the product topology on the space of joint variables. Of course, there are 
examples for different joint measures of the same quenched Gibbs specifica- 
tion for different spin boundary conditions a. In principle, there can even 
be different ones for the same spin-boundary condition a, depending on the 
subsequence. 
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For all of this, think of the concrete example of the random field Ising 
model. Here the spin variables a x take values in {—1, 1}. The disorder vari- 
ables are given by the random fields n x that are i.i.d. with single-site distri- 
bution Po that is supported on a finite set 7^o and assumed to be symmetric. 
The defining potential 5>(cr, rj) is given by &{ x ,y} (°"; v) = —fto~ x o- y for nearest 
neighbors x,y S Z d , $j a ,}(cj, rf) = —hrj x a x , and $a = else. 

6.2. Relative entropy for joint measures. For the first result we do not 
need the independence of the disorder field. In fact, without any decoupling 
assumption on P, we have the following theorem: 

Theorem 6.1. Denote by K a and K a ' two joint measures for the same 
quenched Gibbs specification fi'^[n](da) , obtained with any two spin boundary 
conditions a and a' , respectively, along any subsequences Ajy and A' N , re- 
spectively. Then their relative entropy density vanishes; that is, h(K a \K a ') = 
0. 



Remark 6.2. Note that we are more general than in the usual setup 
and we do not need to assume translation invariance, not even of the defining 
potential 



Remark 6.3. This result is directly related to neither the first part nor 
to the second part of the variational principle. It does not yield the first part 
(which will be proved differently) because it is not clear that every measure 
that is compatible with the same specification as K a can be written in 
terms of K a . Applied to the random field Ising model in Section 6.3, this 
result will disprove the second part of the variational principle for weakly 
but not almost Gibbs measures. 



Proof of Theorem 6.1. We have from the definition of the joint 
measures as limit points with suitable sequences of volumes, 



(6.2) 



lim 



N 



\im N fF(dfj)l VA vi\fj](o- A ) 



K*'{o- A r) A ) \mi N K% (a A rj A ) hm N jF(drj)l 



O-A) 



for the indicator function of the 
event that the integration variable fj coincides with the fixed configuration rj 
on A. We have from the finite range of the disordered potential that 



Here and later we will write for short 1 



'/A 



sup 

cj^a'r) 1 On A 



E(^N-^W)) 



<Ci|<9A| 
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for cubes A with some finite constant C\. By dA we mean the r-boundary 
of A, where r is the range of <I>. So we get that for N large enough, 

exp(-2Ci|dA|)/4[f7A%d\A](o-A) < ^[vaV^^M 

< exp(2(7ij<9A|)/4[77A?ferf\A](>A) 

for any joint reference configuration afj. This gives the upper bound exp(4Ci |<9A|) 
on the right-hand side of (6.2) by application of the last inequalities on the 
numerator and the denominator of (6.2) for the same reference configuration. 

This implies for the finite- volume relative entropy an upper bound on the 
order of the boundary, that is, 

h A (K*\K*') = J2 K^a AVA )log ^ AVA) <4d|dA|. 

The claim h(K 9 \K*) <\hn.sa^ x (l/\A n \)h An (K 9 \K a ') = for (A n ) neN 
a sequence of cubes clearly follows. □ 

The next theorem also can be proved in a natural way when we relax 
the independence assumption of the a priori distribution P of the disorder 
variables. It says that the property of being asymptotically decoupled carries 
over from the distribution of the disorder fields to any corresponding joint 
distribution. Following [23], we give the following definition: 

Definition 6.4. A probability measure P € Mf inv * s caue d asymptot- 
ically decoupled (AD) if there exist sequences g n , c n such that 

lim C " = 0, lim — = 

ra-»oo |A n j re->oo n 

and for all A £ J-\ , B € F A c with F(A)F(B) + 0, 
(6 3) < F{AnB) < e- 

Theorem 6.5. Suppose P is asymptotically decoupled with functions 
g n and c n . Assume that K a is a corresponding translation-invariant joint 
measure of a quenched random system, with a defining finite range po- 
tential. Then K a is asymptotically decoupled with functions g' n = g n and 
c' n = c n + C|<9A n | ; where C is a real constant. 

Proof. It suffices to show that for any finite V C A£ , .,r„\, we have 
(6.4) ^-<)< fffa.fr> - J^S™) , <exp(4,). 
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We show only the upper bound. It suffices to show 

Kl N ^A n VA n crvVv) 
urn sup — — — — r < exp(cTv) 

for any sequence A^v- The quantity under the lim sup equals 
/ Hdfj)t VAn [f)](<TA n <rv) 



(6.5) 



Look at the term under the disorder integral in the numerator. We have by 
the compatibility of the quenched kernels that 

M Ajv [??A„W%d\(A n UV)](^) 1 ^/^An [ 7 ?A„W%d\(A n uV)]( 1 (TA n ) 
< exp(2Ci|5A n |)/i^[7? A „%d\A„](^A„) X M A [?7A n W%d\(A„UV)](l<r v ), 



where the inequality follows from the uniform absolute convergence of the 
quenched potential for any reference configuration afj. 
We use that 

MaJ^a„(7?i)z<*\aJ(0A.J > exp(-2Ci\dAn\)nA n [VA n fi zd \ A J{a An ) 

and the similar lower bound on the first disorder integral in the denominator 
of (6.5) with the same reference joint reference configuration afj. From this 
we get an upper bound on (6.5) in the form 

(6.6) exp(4Ci|aA r 



/ P(<%) i VAn J P(d%)v/*| K M M ' 

Last we need to control the influence of the variation of the random fields 
inside the finite volume rj\ n on the Gibbs expectation outside. We have that 

»l N [VA n Vzd\A n ]((7v) < exp(2Ci|9A n |)/i Ajv [r ?A 1 n ) r/ zd \ An ](cjy) 

for any configurations rj and inside A n . This gives the upper bound 
on (6.6) as 

exp(8Cl|8A "'W)V,JP»)V' 

but this, by the property of asymptotic decoupling of the disorder field, is 
bounded by exp(8Ci |<9A n | + c n ) and the proof of the upper bound in (6.4) 
is done. The proof of the lower bound is similar. □ 

Applying Pfister's theory [23], we have the following corollary: 
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Corollary 6.6. Suppose P is asymptotically decoupled and that K a is 
a corresponding translation-invariant joint measure of a quenched random 
system, with a defining finite range potential. Then h{K\K a ) exists for all 
translation-invariant probability measures K. 



Moreover we have the following explicit formula: 



Theorem 6.7. Suppose that the defining potential &(a,n) is translation- 
invariant and that P is asymptotically decoupled. Suppose that K a is a 
translation-invariant joint measure constructed with the boundary condition 
a. Suppose that K is a translation-invariant measure on the product space. 
Denote by K d its marginal on the disorder variables rj. Then 

h(K\K°) = h(K d \¥) - h{K) - h{K d ) 

+ E |^| K(*A(mi = -)) + K (lim log ZUn = 

where h(K) is the Kolmogorov-Sinai entropy (2.5). 

Remark 6.8. The fourth term has the meaning of the K expectation 
of the joint energy. The last term is the K mean of the quenched pressure. 
Note that it is boundary condition cr-independent, of course. 

Remark 6.9. In the case that P is a Gibbs distribution, the existence 
of the relative entropy density is obtained directly, that is, without relying 
on Pfister's theory. 

Proof of Theorem 6.7. We have 

1 h A {K\K & ) = ^- £ K(a AVA )logK(a A r, A ) 



|A| ilv 1 ' |A| 



C"A»)A 



~ Taj Yj K (a A ri A ) log K a (a aVa), 

where the first term converges to —h(K). For the second term we use the 
approximation 



sup 



log 



HVA)tJ' A [nAVzd\A}(°~A) 



<2Ci|0A|. 



First we have 



~ J2 K(a A n A )logF( VA ) = ^-h A (K d \F) - ±- £iQ(r/ A ) logK d ( VA ). 
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The second term converges to h(Kd); the first term converges to h(Kd\P). 
This is clear either by the classical theory for the case that P is Gibbs or 
even independent, or by Pfister's theory if P is asymptotically decoupled. 
Next, by definition 

lognl[r] A f) zd \ A }(a A ) = - $A((TA0z*\AVAf)z*\A) ~ ^8 Za(VAVz<i\a) ■ 

A: AnAjt0 

Using translation invariance of the measure K, we get that the applica- 
tion of m J K{da\drj A ) over the first sum of the right-hand side converges 

to — J2abo ]Z\K(^a(&ti = ■))• To see that the average over the last term con- 
verges we use the ergodic decomposition of to write Kd{drj) = / p(d,K) K,(dr)) , 
where p{dn) is a probability measure that is concentrated on the ergodic 
measures on rj. Fix any ergodic measure k. For K-a.e. disorder configuration 
77 we have the existence of the limit — liniA m log .^(77 = •) by standard ar- 
guments [25]. The convergence is also in L 1 , by dominated convergence. So 
we may integrate over p to see the statement of the theorem. □ 

6.3. Discussion of the first part of the variational principle for joint mea- 
sures. To discuss the first part of the variational principle, we use an explicit 
representation of the conditional expectations of the joint measures. For this 
we need to restrict to the case that P is a product measure. First, in the 
situation detailed below, we prove the first part of the variational principle 
by direct arguments. Next, we illustrate the criteria given in the general 
theory of Section 3.4 by showing that they can be verified in the context of 
joint measures in the almost Gibbsian case, giving then an alternative proof 
of the variational principle. 

We start with the following proposition from [14]. 

Proposition 6.10. Assume that ¥ is a product measure. Assume that 
there is a set of realizations of r/ of F '-measure 1 such that the quenched 
infinite-volume Gibbs measure p\rj\ is a weak limit of the quenched finite- 
volume measures (6.1). Then a version of the infinite-volume conditional 
expectation of the corresponding joint measure K^(da,drj) =¥(dr])p[r]](da) 
is given by the formula 

(6.7) K»[U\UJ- 



I PT^ 9A ( d VA)QA(VA, VA, 



Here P\ nn, ^ aA (£,A) is the trivial annealed local specification given in terms of 
the potential U A nv (a,7]) = <&A{o~,r}) — 1a={x}1°S^ > o('7x) w.r.t counting mea- 
sure on the product space. Furthermore, we have put 

Qa (Va » Va > VA." ) = [VaVA- } exp ( - AH A (r/ A , r)\ , rj dA ) ) , 
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where 

AnA^0 

According to our assumption on the measurability on /ufry], depends 
measurably on n A c We fix a version of the map and define the right-hand 
side of (6.7) to be the specification 7^. Note that for the random field Ising 
model, this specification exists for all configurations n of the random field 
by monotonicity. 

In this context we always have the first part of the variational principle. 
Note that we do not need any further assumption about almost Gibbsianness. 



Theorem 6.11. Assume that ¥ is a product measure. There exists a 
constant C depending only on P such that for any K, K' E £?(7 M ), one has 



sup 



log- 



K'(Ca) 

In particular, h{K\K') = h{K'\K) = 0. 



<C|0A|. 



Proof. Using K,K' E ^(7^), it suffices to show that we have the esti- 
mate 

7a(£a|£a c ) C \8A\ 

7^a\Cm)~ ' 

where the constant C is independent of A, From the explicit represen- 
tation (6.7) we obtain 



(6i 



Tft&l&O M r'^(a) / ^ 9A (dVA)Q» A (VA,VA,VAc)' 



Using the definition of / u A nn, '* eA and using the finite range assumption on $, 
we obtain the bound e c ' 9A ' for the first factor on the right-hand side of (6.8). 
The second factor on the right-hand side of (6.8) is bounded by 



Using the same argument on /i A nn '^ SA again, we see that the second factor is 
bounded by e^'^L To estimate the first factor, recall the explicit expression 

Qa^a^a,^) = ^[fiAT] A c](exp(-AH A (T] A ,f] A ,r] A c))) 

<e c|9A| //[r/ A 7?A C ](exp(-A^ A (?/A,?/A,??A C )))- 



Qa(va , VA , ?7 A c ) \ / ^ A nn ' ?SA (drjA )Qa(va,VA, VA° 
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Here the inequality follows from the definition of H A and the finite range 
property of <!>. Now use the definition of the quenched kernels and once 
again the finite range of $ to see that the last expectation is bounded from 
above by 

e c| 9A| n [i]AVA- ] (exp ( - AH A (rj A , fj A , rf Ac ) ) ) = Q I (va , VA , Va<= ) • 
This completes the proof. □ 

Let us now check what can be said about the criteria for the first part of 
the variational principle for joint measures. It turns out that it is natural 
to use the criteria given in Section 3.4 with a measure A that is not a Dirac 
measure. Instead, let us take any translation-invariant configuration a and 
put \ :=F ® 5 a o. 

First, using the arguments given in the proof of Theorem 6.7, it is simple 
in this situation to see that the limit (3.14) exists and to give an explicit 
expression for it. 

Proposition 6.12. Suppose that the defining potential <I> is translation- 
invariant. Suppose that K a is a translation-invariant joint measure con- 
structed with the boundary condition a. Then 

4» = -fr(P) + £ I Fidn f^^K f F(d V ) lim -L log Z% [rj\ 

A5Q J \A\ J ATZ" |A| 

exists. 
Put 

H^:={rieH,r)^Q%(r)l,r)l,ri Z d\ x ) is continuous V x , rfc , rfc }. 

Then we have that an G f2 7 p 44> rj G H^. Assume that F[W^] = 1. Then any 
joint measure is almost Gibbs. This was pointed out and discussed in [13, 14] 
and is apparent from the above representation of the conditional expectation. 

Let us remark that whenever K is a translation-invariant probability 
measure on the product space and K a is any joint measure with marginal 
K%{drj) = F(drf), we have that K d (drj) ^ F(dn) h(K\K 9 ) > 0. This is 
clear from the monotonicity of the relative entropy w.r.t. to the filtration 
(see [7], Proposition 15.5c). So h{K\K°) = would imply that h{K d \F) = 0, 
which again would imply = F by the classical variational principle ap- 
plied to the product measure P. So, given a joint measure K a , the class of 
interesting measures is reduced to those that have the same jy-marginal. 

Proposition 6.13. Suppose that F is a product measure and that 7^ is 
the above specification for a translation-invariant joint measure K 11 . Suppose 
that F(7in) = 1- Take K a translation-invariant measure with marginal K d = 
F. Then Condition CI' holds for the measure K for the above choice of X. 



•32 



CH. KULSKE, A. LE NY AND F. REDIG 



PROOF. We have to check that X(d(T 1 dr] 1 )K(da 2 dr] 2 ) ELS. 3j configura- 
tion o^o^o^o^o i s ™ ^7^) where for a configuration a we have written 
°"<o = (°~x)x<o and so forth. This is equivalent to Vko^o £ ^ f° r P ® P- 
a.e. r) , n 2 , since both A and K have marginal P, and the later is immediate 
because it is a product measure. □ 

To illustrate the general theory of Section 3.4 we note the following corol- 
lary: 

Corollary 6.14. Suppose that ¥ is a product measure and that 7^ is 
the above specification for a translation-invariant joint measure K^. Sup- 
pose that f(TCn) = 1. Take K £ Qmvil^) with marginal = P. Then Con- 
dition C2' of Theorem 3.10 is true and hence 

for any translation-invariant spin configuration a . 

6.4. Random field Ising model: failure of the second part of the variational 
principle. Let us now specialize to the random field Ising model. For all that 
follows we denote by K + (dadn) = ¥(di])fi + [rj](da) the plus joint measure. 
Here we clearly mean by /j, + [r]](da) = lim A | Z d [77] (da) the random infinite- 
volume Gibbs measure on the Ising spins. The limit exists for any arbitrary 
fixed 77, by monotonicity. Similarly we write K~(dadn) = ¥(drf)ii~\rj\(da). 
In this situation we have the following proposition: 

Proposition 6.15. Assume that the quenched random field Ising model 
has a phase transition in the sense that /j, + [n](a x = +) > fi~[rj\(o x = +) for 
P-a.e. r] and for some x € Z d . Then the joint measures K + and K~ , ob- 
tained with the same defining potential, are not compatible with the same 
specification. 

Remark 6.16. We already know by Theorem 6.1 that the relative en- 
tropy h(K + \K~) is zero. Thus we prove here that the second part of the vari- 
ational principle is not valid in the case of phase transition for the quenched 
random field Ising model. 

Remark 6.17. In the so-called grand ensemble approach to disordered 
systems proposed in the theoretical physics literature [22], it is implicitly 
assumed that the potential for the joint measure always exists and does not 
depend on the choice of the joint measure for the same defining potential. 
Here we give a full proof that nonunicity of the joint conditional expectation 
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(and necessarily of the corresponding joint potential) really does happen, 
despite the fact that the joint measures are always weakly Gibbs. It is thus 
an important example of a pathological behavior in the Morita approach 
in a well-known disordered system in a translation-invariant situation. For 
a discussion of the problems of the Morita approach within the theoretical 
physics community, see [11, 12, 29]. 

Proof of Proposition 6.15. The proof relies on the explicit represen- 
tation of Proposition 6.10 for the conditional expectations of K + (resp. K~) 
in terms of /i + (resp. We show that / K + (d£, x c)K~(-\£ x c) ^ K + (-). Let 
us evaluate both sides on the event B := {rj x = +, J2 y: \ y - x \=i a y = 0}- 

Using Proposition 6.10, it is simple to see that we have, in particular, 
for the local event rj x = + for any configuration a with J2 y - \ y - x \=i a y = 0' 
the formula 

K + {r] x = +\a x cq x c) = ^1 + J fi + [r] x = -,r] x c](da x )e 2hax ^j = :r + (r] x c). 
So we get that 



k+(b) = J ndfi)^ + W\ f E *y = °) 

\y:\y-x\=l I 



x r + (fj x c). 

Define r~(r] x c) as above, but with the Gibbs measure fjT . Then we have 
J K+(d^ x c)K-(-\^ c )(B) = J F(dfj)»+[fj]( Yl *y = °) x 

\y:\y-x\=l / 

Now it follows from our assumption that for P-a.e. configuration fj, we have 
the strict inequality r + (fj x c) < r~(r) x c). However, this shows that both mea- 
sures give different expectations of B and finishes the claim. □ 

In the following discussion, we show from the weakly Gibbsian point of 
view that K + and K~ have a "good" (rapidly decaying) almost surely con- 
vergent translation-invariant potential. This strengthens the results in [14], 
where the a.s. absolutely convergent potential is not translation- invariant. 

Theorem 6.18. Assume that d>3, (3 is large enough, the random 
fields i] x are i.i.d. with symmetric distribution that is concentrated on finitely 
many values and that hFrj 2 is sufficiently small. There exists an absolutely 
convergent potential that is translation-invariant for the plus joint measure 
K + (da drj) for sufficiently low temperature and small disorder, and it decays 
like a stretched exponential. 



Proof. Applying Remark 5.5 that relies on Theorem 2.4 of [14], we 
have the following fact. 
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Fact (proved in [14]). Assume that if M (<i£) = F(drj)fJ,[r)](da) is a joint 
measure for the random field Ising model. Denote the disorder average of 
the quenched spin-spin correlation by 

c(m):= sup F(dr])\fi[r]}(a x a y ) - fi[r]}(a x )fi[r]}(ay)\. 

x,y : \x—y\=m •> 

Suppose we give ourselves any nonnegative translation-invariant function 
w(A) giving weight to a subset A<zJL d . Then there is a potential U^irj) on 
the disorder space that satisfies the decay property 

/oo 

if the right-hand side is finite. Here w(m) := w({z € 7j d ;z > 0, \z\ < m}), 
where > denotes the lexicographic order. Constants C\ and C<i depend 
on f5, h. If is translation- invariant, then U^{rf) is translation- invariant, 
too. The total potential U tviv (a,r]) + U^(rf) is a potential for K*. Here I7 triv 
is a potential for the formal Hamiltonian —(5 J2<ij> a i°~j ~ hJ2i r li°'i~J2i loglPo(^i)- 

It was already stated in [14] that we expect a super polynomial decay of 
the quantity c(m) with m when m tends to infinity. We remark first that it 
was already stated and proved in [2] that \^[rj\{a x a y ) — n[t]](cr x ) fj,[7]](a y )\ < 
C(rj)e~ C/3d ( x ' v ^ with a random constant C(rj) that is finite for P-a.e. r\. The 
problem is that integrability of the constant is not to be expected. Unfortu- 
nately, Bricmont and Kupiainen [2] did not explicitly control the decay of 
the disorder average c(m). Now we reenter their renormalization group proof 
and sketch how stretched exponential decay is obtained for c(m) . Obviously, 
we cannot repeat the details of the RG analysis here. For a pedagogical ex- 
position of the RG for disordered models, see also [1], where the example of 
an interface model is treated. 



Corollary 6.19 (from [2]). There is an exponent a > such that for 
all m sufficiently large, we have 

(6.9) c(m) < exp(— m a ). 



Sketch of proof based on RG. For the first part we follow [2], Section 8.3, 
page 750. Fix x and y. We are interested in sending their distance to infinity. 
Let us denote by HdlA the half space H := {z £ Z rf ,e • z < a} for a > 0, 
where e is a fixed unit vector. Let us denote hh[v] := ^ m A^H /-*a [v]- By 
monotonicity we have for any configuration of random fields r\ that the 
quenched expectation of the spin at the origin in the measure /i^ [77] is greater 
than that in the measure ^ + [rj\. 
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Repeating the FKG arguments given in the first steps of [2], Chapter 8.3, 
it is sufficient to show stretched exponential decay of the quantity 

as a function of d(H c , 0) to prove (6.9). As in [2] we denote by Eh the "good" 
event in spin space in all of Z rf that there is no Peierls contour around 
that touches the complement of H. Then, in the same configuration r/, we 
have that the right-hand side is bounded by 

4MK)-/['?m)<M + M(^). 

Now, we can always estimate this expectation as a sum over probabilities of 
Peierls contours 

M + W(^)< E M + M(7)- 

7 : int 730, int r ynH°^0 

The problem is that there is no uniform Peierls estimate for all configurations 
of the disorder. There is, however, a "good event" in disorder space G = Gh 
such that there really is a Peierls estimate for all the "long" contours that 
appear in the above sum. The P probability of the complement of this event 
is small and controlled (in a very nontrivial way) by the renormalization 
group construction. For ij £ Gh we really have that 

E ^ + M( 7 )<exp(-C/3d( J f/ c ,0)). 

7: int79O,int7n_H" c ^0 

This is stated as (8.34) in [2]. So we have that 

J F{dri)(j, + [r)](E H ) <P(G C ) + exp{-C(3d{H c ,0)). 

From the construction of the renormalization group in Bricmont-Kupiainen 
we can see that G is expressable in the so-called bad fields N^(r/) in the 
form G = {r ) ,N*(r ) ) =0 V|x| <L,\/k> (log d{x , H c ) /log L)} . L is a fixed 
finite length scale (the block length suitably chosen in the construction of 
the RG). It appears here just as a constant. The x £ 7L d runs over sites in 
the lattice and k is a natural number that denotes the kth application of 
the renormalization group transformation. The renormalization group gives 
the probabilistic control of the form 

P(N^(r ? )^0)<exp(-L^) 

with some r\ > (this follows from [2] Lemmas 1 and 2, page 563) and so 
we have 

F(G C H ) < L d exp(-L rifc ) < L d exp(-d(0,H c ) r2 ) 

fc>(logd(0,i/ c )/lo g L) 

for d(0,H c ) sufficiently large with r\ > r2 > 0. This proves the claim. □ 
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